Method for recognition determination and localisation of at least one arbitrary object or space

ABSTRACT

The invention relates to a method for recognition, determination and localisation of at least one arbitrary object or space and the picking up of said object, by means of at least one robot, in particular, a service robot, which operates independently on a base surface. Said method is achieved, whereby the robot is orientated within at least one room by means of room co-ordinates and/or co-ordinates of arbitrary objects in the room, transmitted to the robot by means of at least one sensor element, in particular, a transponder or transmitter.

[0001] The invention relates to a method for identifying, determining, localizing at least one arbitrary object and/or room and for picking up the at least one object using a robot, particularly a service robot, which is conveyed independently on a foundation, and to a system for carrying out the method.

[0002] Such methods and systems are known on the market and are in common use in a wide variety of forms and versions.

[0003] In particular, mobile platforms, robots, service robots or the like are known which are equipped with extremely complex environment detection systems, such as ultrasound scanners, laser scanners or the like.

[0004] In addition, such mobile platforms contain image processing systems, for example for identifying, scanning in or capturing data for objects in rooms. Corresponding mobile platforms are also known which have environment identification devices for identifying particular objects or the like.

[0005] So that such mobile platforms and robots can be conveyed independently in different rooms, they frequently have associated position-finding systems. These are inaccurate and need to be realigned often.

[0006] In addition, particularly such position-finding systems require exact control and, in particular, programming in order to move these mobile platforms, particularly robots, to the desired location. Such robots are frequently provided with appropriate motion sensors for identifying an obstacle, for example.

[0007] A drawback of the conventional mobile platforms, particularly robots, is that although such environment detection systems, image processing systems and position-finding and motion systems are known on the market in a variety of forms and versions, the complexity of the technology and the extremely high manufacturing costs mean that they are not marketable. Particularly for the consumer, for example as a household or office aid, such mobile platforms are not at all suitable, since they are too expensive to buy and are too complex to use.

[0008] U.S. Pat. No. 5,202,832 describes a system for transporting goods using a movable module which can be conveyed in relation to a second vehicle for the purpose of transferring goods. So that the vehicles can be moved exactly in relation to one another, a plurality of different systems using transmitters and receivers and using lasers and bar codes are required.

[0009] DE 299 12 726 and U.S. Pat. No. 5,172,121 describe driverless vehicles which can be conveyed on rails and are provided with a transponder element for determining their position at quite particular positions.

[0010] The present invention is based on the object of providing a method and a system for identifying, determining, localizing at least one arbitrary object and/or room which eliminate the aforementioned drawbacks and which provide a system, particularly a method, for picking up arbitrary objects in an arbitrary room and dropping them off or providing them at desired locations in a simple, exact and inexpensive manner.

[0011] This object is achieved by virtue of the features of patent claim 1 and those of the coordinate patent claim 9.

[0012] The present invention involves every room being allocated at least one sensor element, particularly a transponder, which contains a quite specific piece of information, if appropriate in encrypted form. This key or code can be used to program an associated room into a robot, particularly a service robot, said programming relating, in particular, to the room's coordinates or to coordinates of fixed devices, shelves, beds or the like. In this way, the sensor element sends these coordinates, if appropriate using the code, as information to the robot, which can then take the room coordinates as a basis for orienting itself and moving in this room on the basis of the signal from the sensor element or transponder. On the basis of its bearing with respect to the transponder, the robot identifies how it can move in the room. The room coordinates can be stored in the robot and can be activated only by the sensor element.

[0013] Another advantage of the present invention is that each arbitrary object situated in the household or office, for example, is allocated a transponder which likewise contains a particular key.

[0014] The transponder sends this key to the robot. The robot stores the data for the individual objects, said stored data relating, in particular, to the name of the object, its size, its weight, and possibly its transport bearing. This allows the robot to identify accurately which object can be found where and at what location in a room.

[0015] If one or other object needs to be picked up, the robot can be conveyed independently as appropriate, with other objects which may be in the way being moved out of the way by the robot as appropriate, or the fixed objects, such as tables, being bypassed as a result of the spatial size coordinates identified by the robot.

[0016] This provides a simple and very inexpensive way for any arbitrary object to be identified, localized and associated and to be picked up by the robot, particularly by its gripping device.

[0017] It is also possible to use the robot to find a particular object which is missing by virtue of the object sending an appropriate signal to the robot, and the room in which the object is situated being able to be localized in this way.

[0018] Such a robot can also be used to perform particular actions and work steps, such as tidying up the household or office and laying the table; furthermore, this can be done in selectable and programmable steps.

[0019] By way of example, it can remove single plates from a shelf or from a cupboard, put them on a table, add corresponding cups or the like, etc. Following a meal, for example, the robot can, upon an appropriate signal, clear the table, if appropriate fill the dishwasher and empty it again when it has finished its wash cycle, or the like. In this context, the invention has no set limits.

[0020] It has also been found to be particularly advantageous to allocate every object at least two sensor elements, particularly transponders.

[0021] This allows an arbitrary object, particularly a transport bearing for the object, to be accurately defined and determined, since two different vectors transmit the signals to the robot, particularly a service robot.

[0022] On the basis of these two vectors, the object, particularly the bearing, and also a transport bearing for any arbitrary object, can be determined exactly and accurately.

[0023] In this regard, by way of example, the robot can pick up a book from a table and put it on a shelf correctly, with the spine of the book facing outward. In this case, the individual transponders are arranged at as great a distance apart as possible, if appropriate on different sides of the object. The intention will also be to allocate a plurality of corresponding sensor elements, particularly transponders, to the object in order to be able to determine its transport bearing exactly.

[0024] The present invention provides a “local positioning system” which can be used to localize and find the position of the objects using the transmitter or sensor element.

[0025] In this case, by way of example, the transmitter, particularly the sensor element, can be provided or arranged in any room, with a receiver being connected to a personal computer, for example.

[0026] In particular, this system can also be connected to a personal computer directly, without a “service robot”, in order to find individual objects in a room.

[0027] In addition, particular information about the objects, such as the parameters described above, can also be entered and defined using a personal computer, for example.

[0028] In this case, the present invention is also intended to cover, by way of example, the entry of fixed objects or the coordinates of one or more rooms into the PC. In particular, the fixed objects and the rooms with correspondingly fixed objects can be separated from movable objects.

[0029] All fixed objects and also the coordinates of each individual room can be entered in advance into the computer and/or into the service robot, for example. The latter then has exact knowledge of where it can move and identifies the coordinates of fixed objects as obstacles, and also the individual rooms for moving.

[0030] In addition, all movable objects can be entered manually and/or automatically into the personal computer once, for example.

[0031] Appropriate scanners or bar codes can also be used to enter this information directly into a computer in data form, particularly regarding the parameters of size, weight, transport bearing, dropoff platform, name of the object, etc.

[0032] In the case of the present “local positioning system”, the robot, the finding of objects and the determination of particular locations for objects can all be controlled centrally, for example from a personal computer.

[0033] Other advantages, features and peculiarities of the invention can be found in the description below of preferred exemplary embodiments and with reference to the drawing, in which

[0034]FIG. 1 shows a schematically illustrated side view of an inventive system for identifying, determining and localizing an arbitrary object and/or room using a robot;

[0035]FIG. 2 shows a schematically illustrated side view of the system shown in FIG. 1 as another exemplary embodiment;

[0036]FIG. 3 shows a schematically illustrated plan view of a plurality of rooms in which a robot, particularly a service robot, can be conveyed;

[0037]FIG. 4 shows an at least partially perspective view of an object equipped with appropriate sensor elements, particularly transponders.

[0038] On the basis of FIG. 1, an inventive system R₁ for identifying, determining and localizing at least one arbitrary object 1.1 to 1.5 has a central sensor element 2.1, particularly a transmitter, which can be arranged, by way of example, on a wall 3 in a room 4.

[0039] The room 4 contains a robot 5 which can be conveyed on a foundation 6. The robot 5, particularly a service robot, can be conveyed independently and is provided with at least one gripping device 7.

[0040] Another important feature of the present invention is that every object 1.1 to 1.5 has at least one allocated sensor element 2.2, particularly a transponder.

[0041] The transponder stores a particular code, numerical code, digits or the like, with this code being sent by the transponder when an appropriate signal is emitted by the robot.

[0042] For each specific transponder or code, the robot 5 stores a corresponding association with an object 1.1 to 1.5 in the form of data. The sensor element 2.2 can be used to store each arbitrary object 1.1 to 1.5 in the robot 5 in the form of data, particularly regarding the parameters for the objects 1.1 to 1.5 including name, size, weight, transport bearing, dimensions, etc.

[0043] In this case, each sensor element 2.2 on each arbitrary object 1.1 to 1.5 can be allocated, by way of example, a name for the object 1.1 to 1.5 and also a dropoff position in an arbitrary room 4 in which the object is normally situated. Particularly also by storing the size data, particularly the size dimensions of the object 1.1 to 1.5, and the opportunity to use the sensor element 2.2, particularly the transponder, to identify where the object 1.1 to 1.5 is situated in the room, the robot 5 identifies how it can get to the selected object 1.1 to 1.5 without corresponding obstacles (not shown) or any other objects being in the way.

[0044] Particularly as a result of the allocation of, by way of example, a size window for every object, for example in the form of a table, the robot 5 identifies that it can bypass the table in the room 4 in which the table is situated in order to remove, by way of example, another arbitrary object 1.1 with free access using the gripping device 7, and in order to drop off this object at another location, for example.

[0045] In the exemplary embodiment of the present invention shown in FIG. 2, a system R₂ is shown in which a sensor element 2.1 is used to transmit the coordinates of the room 5 to the robot 5 centrally, so that the robot in the room 5 identifies all the dimensions of the room and can orient itself for conveyance in this room.

[0046] In addition, it receives via the sensor element 2.1, particularly the transmitter, the corresponding signal for a specific room, and particularly the room coordinates.

[0047] At the same time, the sensor element 2.1 can also be used to localize any arbitrary object 1.1 to 1.5, to identify it and, in particular, to pass it on to the robot 5.

[0048] As a result, in the manner described above, every object is identified, and the size and location of the object in the room 4 or on the foundation 6 is localized for the purpose of picking up said object should this be required, for example, and dropping it off at a particular, selectable point.

[0049] Similarly, by virtue of the localization of the individual objects 1.4 and 1.5, as shown in FIG. 5, for example, the robot 5 can move past the individual objects since its size and its size coordinates and position are known.

[0050] To reach a particular object 1.4, the object 1.5 can also be taken away or moved aside beforehand, for example. Accordingly, FIG. 3 shows how the robot 5 can move freely through the individual rooms 4, with these coordinates of an individual room specifically being made available to the robot 5 on the basis of the individual sensor elements 2.1 (not shown in more detail here) in each room.

[0051] This allows the robot 5 to use these coordinates, which may be entered beforehand, to orient itself in each individual room. The individual sensor elements 2.2, which are not shown in the present case, can be used to identify and to find the position of any arbitrary object 1.1 to 1.5, so that the robot can bypass these objects or can pick them up if desired.

[0052] So that a particular bearing and position, firstly for picking up the object 1.1 to 1.5, and a particular bearing for transporting, particularly a transport bearing, can be identified, it has been found to be particularly advantageous to equip an object 1.6 with, by way of example, two sensor elements 2.2 which are arranged at different locations on the object 1.6.

[0053] In this case, the two sensor elements 2.2, which define one and the same object 1.6 in coded form, are actually at different and, if possible, separated positions, so that the object 1.6 can be localized and positioned exactly as a result.

[0054] This allows the object to be picked up very easily, for example, and, in particular, allows the object 1.6, for example, to be dropped off easily as a book on a bookshelf in this way.

[0055] In this way, the robot 5, particularly a service robot, is given the information to pick up the object 1.6 close to the transponder 2.2, particularly in the area of the spine of a book, in order then to drop off said object on a bookshelf, for example.

[0056] In the case of the present invention, any desired dropoff point can be allocated to any desired object 1.1 to 1.6 under software control. Using an appropriate command, the robot 5 can then go to the individual objects 1.1 to 1.6 which are not at their location, particularly in their room, where they ought to be and can drop them off there.

[0057] This can be used to simplify tidying work considerably. In addition, a fundamentally important feature of the present invention is that, by way of example, finding or going to a particular desired object is very simple.

[0058] In this case, only the object is entered into the robot. The position of the object can easily be found by the robot, or its position in the room 4 can be indicated on a display. This will likewise fall within the scope of the present invention. List of reference numerals  1 Object 34 67  2 Sensor element 35 68  3 Wall 36 69  4 Room 37 70  5 Robot 38 71  6 Foundation 39 72  7 Gripping device 40 73  8 41 74  9 42 75 10 43 76 11 44 77 12 45 78 13 46 79 14 47 15 48 R₁ System 16 49 R₂ System 17 50 18 51 19 52 20 53 21 54 22 55 23 56 24 57 25 58 26 59 27 60 28 61 29 62 30 63 31 64 32 65 33 66 

1. A method for identifying, determining, localizing at least one arbitrary object and/or room and for picking up the at least one object using at least one robot, particularly a service robot, which is conveyed independently on a foundation, characterized in that the robot is oriented in at least one room by using at least one sensor element, particularly a transponder or transmitter, to transmit thereto room coordinates and/or coordinates of arbitrary objects in the room.
 2. A method for identifying, determining, localizing at least one arbitrary object and/or room and for picking up the at least one object using at least one robot, particularly a service robot, which is conveyed independently on a foundation, characterized in that a bearing for the at least one arbitrary object is identified and/or localized and/or identified by equipping said object with at least one sensor element, particularly a transponder.
 3. A method for identifying, determining, localizing at least one arbitrary object and/or room and for picking up the at least one object using at least one robot, particularly a service robot, which is conveyed independently on a foundation, characterized in that an object's bearing is identified and/or localized and/or identified by providing said object with at least one sensor element, particularly a transponder, the transponder being used to transmit specific parameters for the arbitrary object, such as location, bearing, transport bearing, weight, size, type and name of the object.
 4. The method as claimed in at least one of claims 1 to 3, characterized in that every room, in particular every object, is equipped with at least one sensor element, particularly a transponder, with form-specific and/or object-specific data, particularly coordinates, such as size, bearing, weight, type and name of the object or room being entered, if appropriate entered in encrypted form, in the respective sensor element.
 5. The method as claimed in claim 4, characterized in that the sensor element or the transponder or transmitter is used to transmit the room-specific or object-specific data to the service robot, which evaluates these data for the purpose of independently moving in a room in order to pick up or drop off or remove arbitrary objects, the robot using the room-specific data to calculate the bearing thereof itself.
 6. The method as claimed in at least one of claims 1 to 5, characterized in that an arbitrary object's particular bearing is identified by allocating at least two sensor elements, particularly transponders, to said object at different positions.
 7. The method as claimed in at least one of claims 1 to 6, characterized in that a plurality of sensor elements, particularly transponders on the arbitrary objects, are used to transmit various vectors in the form of signals to the robot in order to identify a particular bearing for the object, to pick up said bearing, if appropriate to put it into a transport bearing, and then to drop it off at any desired location.
 8. The method as claimed in at least one of claims 1 to 7, characterized in that the room-specific and/or object-specific data, such as coordinates of the room, size of the room, size, weight, transport bearing and dropoff location for the object, are stored in the robot, and an association code appropriately matched thereto is stored in the sensor element, particularly in the transponder, with fixed objects and/or rooms being entered as fixed variables in the robot and/or in a PC in order to determine a possible conveyance path.
 9. A system for identifying, determining, localizing at least one arbitrary object (1.1 to 1.6) and/or room (4) and for picking up the at least one robot (5), particularly a service robot, which can be conveyed independently on an arbitrary foundation (6), characterized in that the robot (6) is oriented in at least one room (4) by allocating at least one sensor element (2.1), particularly a transmitter, thereto.
 10. A system for identifying, determining, localizing at least one arbitrary object (1.1 to 1.6) and/or room (4) and for picking up the at least one robot (5), particularly a service robot, which can be conveyed independently on an arbitrary foundation (6), characterized in that location coordinates are identified and/or a size for an arbitrary object (1.1 to 1.6) is identified by allocating at least one sensor element (2.2), particularly a transponder, thereto.
 11. The system as claimed in claim 9 or 10, characterized in that the at least one sensor element (2.1, 2.2), particularly a transponder or transmitter, stores coded room coordinates for the robot (5) and/or coordinates relating to the arbitrary object (1.1 to 1.6), such as size, weight, transport bearing, dropoff location.
 12. The system as claimed in at least one of claims 9 to 11, characterized in that by allocating each arbitrary object (1.1 to 1.6) at least one sensor element (2.2), particularly a transponder, the object (1.1 to 1.6) is localized in an arbitrary room (4) independently by the robot (5) or service robot.
 13. The system as claimed in at least one of claims 9 to 12, characterized in that by allocating at least two sensor elements (2.2), particularly transponders, to different positions on an arbitrary object (1.1 to 1.6), it becomes possible to identify a bearing, particularly a transport bearing, for the object (1.1 to 1.6) and also a bearing for dropping off the object (1.1 to 1.6), using at least two different location vectors.
 14. An object having a sensor element (2.2), particularly a transponder, characterized in that the object (1.1 to 1.6) has at least two allocated sensor elements (2.2), particularly transponders, at different positions. 